Setting up Unity Catalogs in Databricks

You can set up unity catalogs in Databricks and reverse engineer them into erwin Data Modeler.

This process involves the following steps:

Creating User Cluster

Creating user cluster enables you to access unity catalogs in Databricks.

To create a user cluster, follow these steps:

  1. Log in to the Microsoft Azure Databricks portal using your Databricks account.
  2. On the left side navigation panel, go to Compute tab, and click Create compute.
    Databricks Unity0catalog Compute
    The cluster configuration page appears.
    Databricks Unity Catalog Config
  3. In the configuration page, configure the parameters based on the following table.

    Fields

    Parameter

    Additional Information

    Access modeSingle user

    Selecting the Single user option will enable Unity Catalog creation in the database.

    Databricks Runtime Version13.3 LTS, 12.2 LTS, and 11.3 LTS

     

  4. Click Create compute.
    Databricks Unity Catalog Create Compute
    The user cluster is created.

Creating Access Token

Once you have created a user cluster, you can generate the access token. You can use this access token to get access to the database using erwin DM.

To generate the access token, follow these steps:

  1. In the right-top corner, click the email address, and select User Settings option.
    Databricks Unity Catalog Token'
    The Settings page appears.
    Databricks Unity Catalog Token Generate
  2. Go to Developer > Access tokens > Manage.
    The Access tokens page appears.
    Databricks Unity Catalog Access Token
  3. Click Generate new token.
    The Generate new token page appears.
    Databricks Unity Catalog Generate Token
  4. Add comments and set an expiry for the token. Then, click Generate.
    The token is generated and this expires after certain days. After expiry, you can generate another token using the above steps.

Accessing the JDBC String

Once the access token is generated, use the following steps to run the user cluster and copy the JDBC string.

  1. Go to Compute tab and locate the user cluster that you created.
  2. Click Icon Databricks Run to run the cluster.
  3. Once the user cluster starts, open the cluster, and expand the Advanced options.
  4. Go to the JDBC/ODBC tab, copy the JDBC string from the JDBC URL section. This string can be used to connect to the Databricks from erwin DM for reverse engineering. For more information about the connection details, refer to the Database Connection Parameters topic.
    Databricks Unity Catalog Jdbc Url
  5. When you copy the JDBC string, ensure that you copy the string up to "AuthMech=3".